Second-order schedules: Manipulation of brief-stimulus duration at component completion     

Steven L. Cohen  Joan E. Hughes  D. Alan Stubbs 《Learning & behavior》1973,1(2):121-124

In a second-order schedule, fixed-interval components were reinforced according to a variable-interval schedule. A brief stimulus accompanied the completion of each fixed interval. Brief-stimulus duration was varied across conditions from 0.5 to 8 sec. Patterning was greater the longer the duration of the stimulus. Additionally, exposure to relatively long brief-stimulus durations enhanced patterning upon reexposure to shorter brief-stimulus durations.  相似文献   

Stimulus functions within a fixed-interval clock schedule: Reinforcement,punishment, and discriminative stimulus control     

R. J. Auge 《Learning & behavior》1977,5(2):117-123

Pigeons received food for responding on a fixed-interval 32-sec schedule divided into three equal parts, each correlated with a distinctive, response-independent, visual stimulus. Response rate was very low during the first two thirds of the interval but high during the terminal third. When a response-dependent brief stimulus correlated with the terminal third was arranged for each response in the presence of the stimuli correlated with the first two thirds, response rate was enhanced, especially in the middle third. However, response rate was suppressed when each response in the presence of the stimulus correlated with the final third produced a brief stimulus correlated with the initial third. A similar suppressive effect occurred when each response produced a brief stimulus correlated with the middle third. Response suppression decreased over successive response-dependent brief-initial-stimulus manipulations. The results were interpreted in terms of reinforcement, punishment, and discriminative stimulus control by visual stimuli correlated with parts of a fixed-interval schedule.  相似文献   

Conjunctive schedules of reinforcement IV: Effects on the pattern of responding of changes in requirement at reinforcement     

Jonathan L. Katz  James E. Barrett 《Learning & behavior》1979,7(4):483-488

The effects of different schedule requirements at reinforcement on patterns of responding by pigeons were assessed under conjunctive schedules with comparable response-number requirements, Under one conjunctive schedule (conjunctive fixed-interval fixed-ratio schedule), a response was reinforced after a 6-min interval had elapsedand a specific minimum number of responses had been emitted, Under a second conjunctive schedule, a response was reinforced after the 6-min fixed interval and upon completion of a tandem schedule requirement (conjunctive fixed-interval tandem schedule), This schedule retained the same required minimum number of responses as the first conjunctive schedule, but responses were never reinforced according to a fixed-ratio schedule; the tandem schedule was comprised of a fixed-ratio and a small (.1 to 10.0 sec) fixed-interval schedule, Under the conjunctive fixed-interval fixed-ratio schedule, responding was characterized by an initial pause, an abrupt transition to a high response rate, and a second transition to a lower rate that prevailed or slightly increased up to reinforcement, Under the conjunctive fixed-interval tandem schedule, pauses were extended, response rates were lower, and the initial high rate of responding was generally absent, The above effects depended upon the size of the fixed interval of the tandem schedule, The distinct pattern of responding generated by conjunctive fixed-interval fixed-ratio schedules depends upon occasional reinforcement of fixed-ratio responding and not merely on the addition of a minimum number of required responses.  相似文献   

Variations of two temporal parameters in observing response procedures     

Kendall  Stephen B. 《Learning & behavior》1975,3(3):179-185

Temporal parameters were varied in two different observing response procedures. In Experiment I, concurrent variable-interval chain schedules were employed. Responding on one key led to either a stimulus correlated with reinforcement or a stimulus correlated with time-out. Responding on the other key led to a stimulus which ended either in reinforcement or time-out. The duration of the delay to reinforcement or time-out was varied, the delays for all three stimuli always remaining equal in a given phase. It was found that the longer the delay, the greater the preference for the observing response. In Experiment II a procedure was employed in which birds pecked during a “trial” to produce stimuli correlated with reinforcement or time-out at the end of the trial. The duration of the trial ending in time out was varied while the positive trial duration remained constant. It was found that the longer the duration of the negative trial, the greater the strength of observing responses. The results were interpreted as supporting the hypothesis that the value of a positive stimulus is a function of time spent in stimuli correlated with nonreinforcement.

  相似文献   

The effect of localizing the stimulus at the response key on generalization along the hue dimension in the pigeon     

W. Kirk Richardson  Mark S. Evans 《Learning & behavior》1975,3(2):119-122

After training with a variable-interval schedule of positive reinforcement, pigeons were tested for stimulus generalization along the hue dimension. For one group, the stimulus was located on the response key. For a second group, the stimulus was located on a surface adjacent to the response key. The stimulus-on-key group produced the typical steep gradients normally found with hue stimuli; the stimulus-off-key group produced flat gradients. After discrimination training between the presence and absence of the hue stimulus, both groups produced decremental gradients. In a second experiment, naive pigeons were trained to peck a transparent key with the stimulus surface located approximately 3.8 cm behind the key. When tested for generalization, the hue gradients were decremental. The results suggest that location of the stimulus in the line of sight with pecking is a necessary condition for stimulus control by hue after nondifferential training.  相似文献   

The overshadowing of instrumental conditioning by a stimulus that predicts reinforcement better than the response     

Robert St. Claire-Smith 《Learning & behavior》1979,7(2):224-228

In an experiment designed to demonstrate the overshadowing of appetitive instrumental conditioning, three groups of rats were given 10 sessions of RI (random interval) training in which reinforcement was delivered 450 msec following the response. The correlated group experienced a stimulus during the response-reinforcer delay interval, while an uncorrelated control group experienced a similar brief stimulus occasionally following responses, but these were not responses that typically produced reinforcement. A no-stimulus control group did not experience the brief response-produced stimulus. The experiment was run in two replications. The first employed a light as the critical stimulus, the second a tone. Over the 10 RI sessions, subjects in the two control conditions increased their rate of responding significantly faster than subjects in the correlated condition in both replications. This finding was interpreted as an instance of the overshadowing of the acquisition of signal value by a response because of the presence of the stimulus, which, in the correlated condition, was a more reliable predictor of reinforcement than the response. A subsequent conditioned reinforcement test confirmed that, in the correlated condition, the stimulus had, indeed, become a signal for reinforcement as a function of RI training.  相似文献   

The effects of stimulus similarity on different types of behavioral contrast     

Ben A. Williams 《Learning & behavior》1988,16(2):206-216

Pigeons were trained on multiple schedules with component stimuli of different degrees of similarity. In Experiment 1, a two-component schedule was used in which the two stimuli were either two line orientations or a line orientation versus a diffuse color. Reinforcement rate was varied in one component to determine the effects of stimulus similarity on different aspects of behavioral contrast. Contrast in terms of average response rates (molar contrast) was larger with less similar stimuli. Local contrast effects at the beginning of the component were larger for more similar stimuli, but these effects were more variable and did not attain statistical significance. Independent of the level of molar contrast, the local pattern of schedule interaction differed for the two levels of similarity: with more similar stimuli, the maximum degree of interaction occurred at the beginning of the components and then decreased; with less similar stimuli, the degree of interaction increased throughout the components and was at its maximum near their end. In Experiment 2, the same three stimuli were used while reinforcement rate in the middle component of a three-component sequence was varied; this isolated the effects of the preceding schedule from those of the following schedule. Contrast effects were generally greater in the target component preceding the variable schedule, and these were enhanced by less similar stimuli. Contrast in the target component following the variable schedule was manifested primarily in terms of the behavior at the beginning of the component, and these effects were inconsistently related to stimulus similarity. The functional separation of the effects of stimulus similarity on the different locations of contrast suggest that “anticipatory contrast” and “local contrast” depend upon different mechanisms, thus excluding any account of contrast solely in terms of relative rate of reinforcement.  相似文献   

Signal properties of reinforcement and reinforcement omission on a multiple fixed-ratio schedule     

Louis D. Matzel 《Learning & behavior》1985,13(2):187-193

A series of experiments used food-deprived pigeons to examine several parameters of reinforcement omission in an attempt to control changes of keypeck response measures on a subsequent schedule. In Experiments 1 and 2, the pigeons were tested with a multiple fixed-ratio schedule on which reinforcement was occasionally omitted at the completion of the first component. The duration of the delay occurring in lieu of reinforcement was systematically varied. In Experiment 3, the stimulus that signaled the second component of the schedule was altered to appear either more or less similar to the stimulus that signaled the first component. Two principal results are reported: (1) Response latency decreased and, to a much lesser extent, terminal response rate increased as the delay occurring in lieu of reinforcement decreased; and (2) both latency decrease and response-rate increase were enhanced by a second component stimulus which was similar to the first. The results are evaluated in terms of Amsel’s frustration theory and an analysis by Staddon which suggests that reinforcement inhibits responding. The data appear to support Staddon’s argument that rate increases and latency decreases following reinforcement omission are largely a function of an attenuation of the inhibitory influence of reinforcement, an effect that is enhanced by stimulus generalization. Accordingly, it is proposed that an animal’s response to reinforcement omission is determined by a stimulus complex that minimally includes the omission event and component cues.  相似文献   

The role of trial tracking in rats’ working memory     

J. S. Cohen  M. Njegovan 《Learning & behavior》1999,27(2):211-220

The experiments reported in the present study tested whether decreasing intertrial intervals (ITIs) intensifies the disruptive effects of increasing retention intervals (RIs) in a delayed conditional discrimination by decreasing the animal’s trial tracking accuracy (Cohen & Armstrong, 1996; Cohen & Roberts, 1996). Rats responded on a fixed ratio (FR) 1 or fixed interval (FI) 10-sec reinforcement schedule at a second light or tone stimulus, S2, when the first light or tone stimulus, S1, had signaled an FI 10-sec or FR 1 schedule, respectively. RIs between S1 and S2 were increased from 3 to 24 sec and never exceeded ITIs that were reduced from 24 to 6 sec. For some rats, the trials were separated from each other by extending the lever at S1 and retracting it at the end of S2 (ITI lever-retracted group). For other, control rats, the lever remained extended throughout the session (lever-extended group, Experiment 1) or was extended and retracted with the onset and offset of each stimulus (RI/ITI lever-retracted group, Experiment 2). The rats under all trial conditions learned to delay leverpressing on the FI 10-sec schedule. Latency to begin leverpressing on the FI 10-sec schedule declined as RIs were increased, but this effect was attenuated in the ITI lever-retracted groups in both experiments, as would be predicted by thetrial tracking hypothesis. Decreasing ITIs from 24 to 6 sec intensified the disruptive effects of increasing RIs from 3 to 6 sec in the RI/ITI lever-retracted group (Experiment 2), as would be predicted by the trial tracking hypothesis.  相似文献   

Functional differentiation of adjunctive drinking and wheel running in rats     

John Penney  Jonathan Schull 《Learning & behavior》1977,5(3):272-280

Food-deprived rats were exposed to a schedule in which a brief stimulus was presented approximately once every 60 sec. The first leverpress to occur in the presence of the stimulus always turned it off, and produced a food pellet 50% of the time. When the rats were given concurrent access to water, a running wheel, or both, drinking predominated during intervals initiated by pellet delivery, while running predominated during intervals initiated without food. When allowed to obtain all of their food pellets at the beginning of a session, rats drank less and ran more than when the intermittent schedule was in effect, and most drinking occurred within the first half of the session, while running was distributed throughout the session. Adjunctive drinking and wheel running appear to be functionally different, drinking being schedule-induced and food-bound, running being neither.  相似文献   

Overshadowing by food of stimulus control by a keylight in a two-element serial compound     

M. E. Rilling  R. C. Howard  C. M. Johnson 《Learning & behavior》1980,8(4):601-608

Pigeons were given successive discrimination training in which pecking during a choice period when the key was white was either reinforced or not, depending upon the prior presence or absence of a discriminative stimulus, which was a two-element serial compound. The compound consisted of a keylight and food, with food presented second or first in a forward or backward pairing for different groups of pigeons. In Experiment 1, the sequence was an S+ indicating reinforced trials, while in Experiment 2, the sequence was an S? indicating nonreinforced trials. Following acquisition of discriminated operant behavior, a sequence generalization test was administered during which all possible orders of the two stimuli were presented on test trials prior to the onset of the choice period. The results showed that food overshadowed stimulus control by the color of the light on the key on the sequence-generalization test, independently of whether food was presented first or second during training and independently of whether food was associated with reinforcement or nonreinforcement. The similarity of results for the two experiments suggests that overshadowing occurs independently of whether the compound is a discriminative stimulus for reinforcement or nonreinforcement. Simultaneous presentation of elements of a compound stimulus is not necessary for overshadowing because the phenomenon was captured with sequentially presented stimuli.  相似文献   

The Robustness of Infant Haptic Memory: Testing Its Capacity to Withstand Delay and Haptic Interference   总被引：1，自引：0，他引：1  

Di Catherwood 《Child development》1993,64(3):702-710

The robustness of infant haptic memory was assessed in terms of its capacity to withstand either a brief delay or potential retroactive "interference" from other haptic input. 48 infants (mean age 8 months) were familiarized haptically to a small cube or sphere with smooth or rough surface texture and subsequently tested for recognition of the shape and texture of this stimulus in terms of the relative level of haptic response to 3 test stimuli, comprising the familiar stimulus, a new-shape stimulus, and a new-texture stimulus. The test stimuli were presented ( a ) immediately, ( b ) after a 5-min delay, or ( c ) after a second familiarization or "interference" phase involving another haptic stimulus different in shape and texture to the first. The infants demonstrated recognition of shape and texture in the No Delay condition, of shape and (marginally) of texture in the Delay condition, but only of texture in the Interference condition. The greater susceptibility of shape to interference was considered in terms of the degree of similarity among the shapes employed in the study.  相似文献   

Response rate is not an effective mediator of learned stimulus equivalence in pigeons     

Frank AJ  Wasserman EA 《Learning & behavior》2005,33(3):287-295

We explored response rate as a possible mediator of learned stimulus equivalence. Five pigeons were trained to discriminate four clip art pictures presented during a 10-sec discrete-trial fixed interval (FI) schedule: two paired with a one-pellet reinforcer, which supported a low rate of responding, and two paired with a nine-pellet reinforcer, which supported a high rate of responding. After subjects associated one stimulus from each of these pairs with a discriminative choice response, researchers presented two new clip art stimuli during a 10-sec FI: one trained with a differential reinforcement of low rate schedule (DRL) after the FI and the other trained with a differential reinforcement of high rate schedule (DRH) after the FI. Each of the stimuli that were withheld during choice training was later shown to see if the choice responses would transfer to these stimuli. The results suggest that response rate alone does not mediate learned stimulus equivalence.  相似文献   

Stimulus modality and short-term memory in rats     

Julia Wallace  Pamela A. Steinert  Stanley R. Scobie  Norman E. Spear 《Learning & behavior》1980,8(1):10-16

Two experimental paradigms are presented aimed at determining the retention of auditory and visual information over brief delay intervals. First, a conditional delayed matching-to-sample procedure was used in which rats were required to symbolically match the modality of the sample stimulus with one of two comparison stimuli. In the second experiment, subjects were trained and tested using a Konorski-type procedure. Despite the conceptual and procedural differences between the two procedures, subjects in both experiments showed steeper forgetting functions for visual events than for auditory events, while performance levels at 0-sec delay intervals were equivalent for both stimuli. These results, when taken together with related research conducted with pigeons, suggest that content of memory may have important influences on the short-term retention abilities of animal subjects.  相似文献   

Microanalysis of variable-interval performance during stimulus compounding     

M. Catherine Bushnell  Stanley J. Weiss 《Learning & behavior》1978,6(1):66-71

Additive summation is observed when more responses are emitted to the simultaneous presentation (tone-plus-light) of independently conditioned stimuli (tone and light) than to either stimulus presented alone. The current experiment sought to determine if this increased rate during tone-plus-light was a function of a new modal interresponse time (IRT) or a differential mixing of pauses with a modal IRT characteristic of the responding in tone and light alone. Three rats were trained on a three-component multiple schedule where tone and light were each associated with a variable-interval 30-sec schedule while a variable-interval 100-sec operated in the simultaneous absence of these stimuli, tone-off and light-out. Baseline response rates were 2–4 times as high in tone or light as in their absence. In testing, more responses were emitted to tone-plus-light than to tone or light by all animals, but the modal IRT was in the 0.2–0.4-sec IRT bin for all test conditions. Tone-plus-light controlled fewer long IRT values and more responses in the short modal category than tone or light alone. These results support the response mixing hypothesis of stimulus control; i.e., no “new” behavior was observed during the novel combination of stimulus elements, only a mixture of previously reinforced behavior patterns in different proportions.  相似文献   

Preference between fixed-interval and variable-interval schedules of reinforcement: Separate roles of temporal scaling and predictability     

Paul W. Frankel  Walter Vom Saal 《Learning & behavior》1976,4(1):71-76

Pigeons’ preference between fixed-interval and variable-interval schedules was examined using a concurrent-chains procedure. Responses to two concurrently available keys in the initial links of the concurrent chains occasionally produced terminal links where further responses were reinforced under either a fixed- or variable-interval schedule. In previous studies, preferences for the variable schedule with such a procedure have been interpreted as reflecting atemporal scaling process that heavily weights the shorter intervals in the variable schedule. The present experiment examined whetherpredictability, i.e., the presence of external stimuli correlated with the reinforcement interval, might also influence preference in such situations. When the two intervals in a variable schedule were made predictable by being associated with different key colors, preference for that schedule increased. This increase was reliable but small in magnitude and transient when initial-link responses only occasionally produced terminal links; it was large in magnitude when only one response in the initial link was required to produce the appropriate terminal-link schedule. The results suggest that preference between fixed and variable schedules may be influenced both by temporal scaling and to a lesser extent by predictability of the reinforcement intervals.  相似文献   

Reductions in resistance to extinction and spontaneous recovery as a function of changes in transportational and contextual stimuli     

Robert L. Welker  Kathleen McAuley 《Learning & behavior》1978,6(4):451-457

Thirty rats received 10 sessions of baseline training in which leverpressing was reinforced according to a variable-interval (VI) 60-sec schedule. Twenty-four of the subjects were then assigned to one of four groups that received five sessions of extinction, with groups being differentiated in a 2 by 2 factorial design on the basis of: (1) changes in stimuli accompanying transportation of subjects from home cages to the laboratory and placement in the apparatus, and/or (2) changes in contextual stimuli within the apparatus. During the sixth session of extinction, the transportational and contextual stimuli previously associated with baseline training were reinstated. The remaining six rats experienced changes in both transportational and contextual stimuli but were maintained on the VI 60-sec schedule of reinforcement. Changes in either transportational or contextual stimuli reduced resistance to extinction and spontaneous recovery, and substantial increments in responding occurred upon reinstatement of the transportational and contextual stimuli associated with baseline training. Evidence for summation of the two sources of stimulus change was obtained. Changes in transportational and contextual stimuli produced only a brief disruption in responding when reinforcement of leverpressing was continued.  相似文献   

Effects of changeover contingencies on auditory stimulus control of two responses     

Marc N. Branch  Frederick W. Hegge 《Learning & behavior》1974,2(1):34-38

Rats were exposed to a procedure in which auditory stimuli signaled which of two levers was associated with a variable-interval 60-sec schedule of food presentation. Presses on the lever that was not associated with the variable-interval schedule (“errors”) postponed availability of reinforcement on the other lever by either a fixed number of responses or a fixed amount of time. Increasing the number of responses by which “errors” postponed food availability enhanced the level of stimulus control, and. alter a relatively high degree of control had been achieved, reduction of the requirement had no effect. Control experiments ruled out extended exposure to the discrimination procedure as a factor in the increase in stimulus control and suggested that the time of introduction of a changeover contingent is an important determinant of its effect.  相似文献   

The influence of brief stimuli uncorrelated with reinforcement on choice between variable-ratio schedules     

Phil Reed  Val Szczudlo  Alan Willis  Geoffrey Hall 《Learning & behavior》1993,21(2):159-167

Experiment 1 investigated the behavior of rats trained to leverpress on a concurrent variable ratio (VR) 30 VR-30 schedule with a brief, 500-msec, light occurring at the midpoint of the ratio on one of the levers. Higher response rates were recorded on the lever associated with this stimulus, a finding that paralleled the effect produced by inserting primary reinforcement at the midpoint (i.e., by training on a concurrent VR-30 VR-15 schedule). Similar results were found in Experiment 2 using a concurrent VR-20 VR-20 schedule with a 2-sec visual stimulus presented midway through one of the components. In addition, a brief stimulus inserted midway through the VR-20 component of a concurrent VR-20 VR-10 schedule retarded the development of a difference in response rates between the components relative to a VR-20 VR-10 group lacking the signal. In Experiment 3, multiple VR VR schedules were used. Again, the response rate was higher in the component that had the added stimulus or, for a second group of subjects, on the component with the smaller response requirement. Probe-choice trials revealed a preference for the component that generated the higher rate in both groups. Presenting a stimulus partway through a ratio appears to reduce the effect on response rate and choice of a large ratio value.  相似文献   

Maintenance of observing responses with the less highly valued stimulus in pigeons     

Stephen B. Kendall 《Learning & behavior》1974,2(3):210-214

Previous research has shown that the more valued stimulus will maintain observing responses but the less valued stimulus will not. In the first part of this experiment, it was shown that the removal of the stimulus associated with the fixed-ratio component of a multiple schedule (mult FI 2 min, FR 35) abolished observing responses. In the next part, the ratio stimulus was phased out by making it available during some ratios but not during others. Observing responses were maintained following the phasing procedure even when all ratio stimuli were unavailable. In the third part, all stimuli, both ratio and interval, were unavailable. Observing responses declined under this condition and increased again when the stimulus associated with the interval was again made available. It is hypothesized that observing responses will be maintained as long as they permit the maintenance of a discrimination.  相似文献